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Abstract. The uncertainty principle of SE{2) allows to construct a coherent 
states transform that is strictly related to the Bargmami transform for the group 
H^. The corresponding target space is characterized constructively and related 
to the almost complex structure of SE{2) as a contact manifold. Such a coherent 
state transform provides a model for neural activity maps in the primary visual 
cortex, that arc then described in terms of minimal uncertainty states. The results 
of the model are compared with the experimental measurements. 
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1. Introduction 

Several notions of coherent states have been formulated that capture in great generality 
many aspects of this intrinsically interdisciplinary territory [T]. Perhaps the most 
classical one when dealing with Lie group symmetries is that of Gilmore-Perelomov 
(GPCS) [221 11], that considers the orbits of some given fiducial vector under the 
action of irreducible unitary representations of the Lie group of interest. The main 
issue arising when this notion is applied to the Euclidean groups E{n) is that the 
irreducible representations are not square integrable, hence no resolution of unity is 
provided by hnear superposition on L'^{E{n)) of projectors, since this would give rise 
to divergence. This problem has been addressed in [THj, with the use of reducible 
representations constructed as direct integrals over finite intervals of representation 
parameters, while in [1] the authors provide square integrable representations on the 
related homogeneous spaces as an application of a powerful result wich makes use of 
the geometry of coadjoint orbits for semidirect product groups. Moreover, in [T] it is 
also pointed out that the construction of reproducing kernel Hilbert spaces (RKHS) 
is always possible for GPCS, independently on the square integrability, by restricting 
to the target of the corresponding coherent state transform. 

We addressed the problem from a different perspective. Our approach is strongly 
motivated by the studies concerning the geometrization of the structure of the primary 
visual cortex (VI) in mammals [iSJ [23J [T^, the first cortical region involved in the 
processing of visual stimuli captured by the retinal receptors |16j . The functional 
architecture of VI presents indeed the concurrency of two different symmetries, since 
the action of single neurons can be modeled as a linear filtering of retinal images 
with the (canonical) coherent states of the second Heisenberg group [T31 Hi] , while 
the internal axonal connectivity can be described in terms of the Lie algebra of the 
group of Euclidean motions of the plane SE{2) |12j. These two symmetries are tied 
together by the so-called orientation preference maps (0PM), that are mappings from 
the Euclidean plane to the real projective line P-'^ defining at each point of VI, 
represented as a flat surface, the orientation of the Gabor filter corresponding to the 
relative cell [22] • These maps contain then informations on how coherent state analysis 
of two dimensional images is performed by VI neurons using a two dimensional set of 
parameters instead of the total four dimensional set, due to the layered structure of 
VI, and have proven to be intimately related with the connectivity 0. 

The purpose of linking these two apparently unrelated symmetries has lead us 
to the GPCS notion of Euclidean coherent states, with fiducial vector chosen as a 
minimizer of the uncertainty principle for the irreducible representation of SE{2). 
The corresponding RKHS can be related to the abstract construction explained in 

but its concrete realization contains some extra structure which is relevant for 
the understanding of this specific problem. More precisely, the characterization of 
the space of surjectivity for the coherent state transform is similar to the one of the 
well known Bargmann-Fock space: an summability condition, but with respect 
to a singular measure, and a complex differentiability condition. This is not trivial, 
since the dimension of SE{2) is odd, and hence it can carry only an almost complex 
structure analyticity is then replaced by the weaker CR condition [4 . Then, 
while complex differentiability is enough to get surjectivity for H^, in this case the 
excess of redundancy in the coherent state transform needs also to be controlled by 
the measure. Moreover, this RKHS coincides with the target space of the canonical 
Bargmann transform when this last is restricted to irreducible Hilbert spaces for the 
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representations of SE{2). This result provides then a Unk between the two symmetries, 
and also motivates the CR condition, which naturally arises from the corresponding 
restriction of the ordinary Cauchy-Riemann equations. 

In [3] we provided a model of the structure of 0PM [51 [7| [3] grounded on 
neurophysiological findings, which is able to reproduce neural activities of VI measured 
in the in- vivo experiments and is in agreement with the proposed notion of coherent 
states. We would like to emphasize that this concrete application provides not only 
a motivation for the entire work, but also an example of a biological system whose 
remarkable organization can be deeply inspiring and demanding. 

The paper is organized as follows. In Section[2]we first provide precise definitions 
of the irreducible Hilbert spaces for the representations of SE{2), following the 
classical approach introduced in |28[ . Then we define the natural coherent state 
transform acting on L'^{S^) and with Theorem 2.18 we characterize its Hilbert space 
of surjectivity V¥q. After a comparative discussion on the group structures of and 
SE{2), with Theorem 2.23 and Corollary 2.24 we then explicit the functional relations 
between the two symmetries, showing that the newly defined transform acts as the 
projection of the classical Bargmann transform on V¥q. In Section [s] we present, as 
the fundamental application, the model for activated regions of VI introduced in [5]: 
after a description of the functional architecture of VI and of the experimental setting, 
we precisely state the model in terms of the introduced coherent states and compare 
the results with the measurements. 



2. Lie group symmetries and coherent states 

2.1. The group SE{2) and the Heisenberg groups 

The Euclidean motion group SE{2) — y\ Sl is the noncommutative Lie group 
obtained as semidirect product between translation and counterclockwise rotations of 
the Euclidean plane with the usual composition law {q\ 0') ■ (g, ff) = {q' + rg/g, 9' + 0) 
[2S1 lU . The left invariant vector fields can be calculated as [T^ 

Xi^ — sinOdq^ + cos 9dq2 , X2 — dg (1) 

whose commutator is given by 

X3 = [Xi,X2] = cos 6*9,1 + sinddq^ . 

Since the two vector fields ([T]) together with their commutator span the tangent space 
at any point, by Chow theorem |20] every couple of points can be connected by curves 
that are piecewise Lie group exponential mappings 

{q\9') = ExpitiXi+kX2)){q,9) (2) 

for some t,k & R, i.e. the group SE{2) is naturally endowed with a so-called sub- 
Riemannian structure. The nonintegrable distribution of planes provided by Xi and 
X2 defines then a contact structure, associated to the contact form 

uj — cosBdqi + sm9dq2 (3) 

and SE{2) can be seen as the double covering of the manifold of contact elements of 
the plane x P^. This last one is not orientable and hence can not carry a global 
contact form [6 , but it is useful to note that it arises naturally as the projectivization 
of the four dimensional phase space [2] . 
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If we denote by H" the n-th Heisenberg group [HI |2Q] in its semidirect product 
form XI (Ep x E^), defined by the group law 

{P,q,t') ■ {p,q,t) = {p +p,q + q,t' + t+pq) 

we note that, by an argument analogous to the one expressed for SE{2), we can 
associate to it a contact structure in the Darboux normal form [31 [S] 

ujQ — pdq — dt 

in accordance with the notion of H" as a central extension of the commutative E^". 

Darboux theorem tells then that locally the geometry of SE{2) is that of M^, 
which indeed is its metric tangent cone [TS]. Moreover, as we noted, the contact 
structure ^ is directly inherited by the symplectic structure of the phase space E*, 
whose central extension returns the group. This will be the point that will permit to 



relate, in subsection 2.4 the groups SE{2) and H in terms of the complex structures 



underlying their coherent states transforms. 

2.2. Coherent states of the Euclidean motion group 

We consider the coherent states of SE{2) obtained with the Gilmore-Perelomov 
(GPCS) definition [231 [T]. starting from a minimum of the uncertainty principle. In 
order to do that, we make use of the irreducible representations of SE{2) [53 HZ], and 
of the related algebra representation. 

Proposition 2.1. The action of the irreducible unitary representation of SE{2) with 
parameter 51 G E on u £ L^(S^) is given by 

and for any (po G we obtain a representation that is unitarily equivalent to up 
to rotations, as 

Corollary 2.2. The representation of the Lie algebra of SE{2) reads 

dn"*oXi„ = zr!sin((^-0o) , dn"*oX2„ = ^ (6) 

where Xi^ and X2„ are the infinitesimal generators corresponding to the left invariant 
vector fields 

Minimal uncertainty states for SE{2) in the irreducible representation can be 
obtained as eigenvectors of the properly constructed annihilation operator [14] in terms 
of the operators provided by (|6| . This specific uncertainty principle has been discussed 
e.g. in [TTl |10[, and we will be interested only in the eigenvector with eigenvalue zero. 

Proposition 2.3. The equation for minimal uncertainty states with zero average 
angular momentum Ul}/ reads 

^ + Af7sin((^-0o) =0 (7) 

^dip J 

and is solved by 

where N is the LF'{S^) normalization. For (pQ = we will simply denote them as w^'^. 

GPCS can then be constructed starting from the fiducial vector u'^'^. 
Definition 2.4. We consider the family of coherent states for the group SE{2) 

V'^'^^(g,0;(p)=n"(g,%^'"((p) . (8) 
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2.3. The Bargmann transform for the two dimensional Euclidean group 

This subsection is devoted to the analysis of the coherent state transform defined by the 
family ([s]), which we will call 5-E(2)-Bargmann transform in analogy with the classical 
Bargmann transform (see also Theorem 2.23 ). Its Hilbert space of surjectivity, denoted 
T^Fq is the space of functions on SE{2) that satisfy an summability condition and a 
complex differentiability condition, as for the ordinary Bargmann space [Mj. Following 
the classical strategy used in \^ to characterize the irreducible Hilbert spaces for the 
representations of SE{2), the summability with respect to the variables is expressed 
in terms of a Hilbert space Hn which, roughly speaking, consists of functions whose 
Fourier transform is concentrated on a circle, and hence can be treated as functions in 
L'^{S^). The complex differentiability relies instead on the almost complex structure 
that can be associated to SE{2) as a contact manifold [6 , and tells that VW^ is a 
space of CR functions H] . 

Definition 2.5. We will call SE (2) -Bargmann transform of a function $ G L?{S^) 

6i^$(g,0)-(tf^(g,0)u^^",a>)i.(si) (9) 

We start now the construction of the Hilbert space T-Ln • In what follows we will 
use for the (unitary) Fourier transform the convention 

^f{k) = ^ I e-^''-^f{x)dx . 

Definition 2.6. Let f e 5(E^) be a function in the Schwartz class and call f E 5(M^) 
its Fourier transform. We define the distributions 

f''{k)^f{k)^6m-^)^S'iR') 

Mix)^-^f^jo{n\-\)ix)= ( f[y)j,{n\x-y\)-pL^eS'{^^) 

where Jq stands for the Bessel function of order zero 

We will also call the corresponding operators from S to S' 

V''f{k) = f\k) ; Vnf{x) = fn{x) . 

Definition 2.7. By | • | we denote the seminorm on S{K^) 

\f\'' = {{f\fh's)'^' (10) 

noting that | / | ^ = ( J-g^2 \f{k)\'^diiQ{k) j , where d^n{k) = ^(5(|fc| — Vl)dk, and by 
\ ■ \ a, we denote the functional on S{M?) 

\f\n^{{fnJ)s'sf"- (11) 

The introduced operators V and functionals \ ■ \ are related by distributional 
Fourier transform, as expressed by the following lemma. 

Lemma 2.8. The following hold 

i) Vn = J-^^V^^J- in distributional sense 

n) \f\n^\f\'' for all f e S{R^) 
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Proof. The first claim reads equivalently Tfn = . To this end we only need to show 

[Tj,{n\-\))[k)^-5{\k\~n) (12) 

since by standard arguments on tempered distributions 

{^fn) (k) = [Tf * ■ I)) (fc) = ^f{k) {Fj.m ■ I)) (fc) . 

To see take V e S{R^) 

— ((5(|fc| — Vl),F^)s's ~ I i) cos tf.Vt SUV Lp)dLp 

i ' .In 



27r f f. /'27r 



The second claim is then a consequence of Definition |2.6| and the distributional 
Parseval theorem, since {fnj)s's = {J^.fn,J^f)s'S- □ 



Definition 2.9. Let be the equivalence relation induced by (10) 

fi-^'h ^ \fi-f2\" = o 

and [-J^ the corresponding equivalence classes. We call'H^ the space 11^= S{M?)/ 
and denote by [/]^ its elements. 

By definition, then, we have that f • -j" ^ is a norm on "H ^. Moreover, since this 
quotient keeps only informations on the behavior of functions on the circle of radius 

f2, then the elements of can be considered as functions of the polar angle. 
Lemma 2.10. "H*^ ^ " ~ L^iS^) 

Proof. Any element [f]^^ EH^^ is represented by a function of the polar angle of k as 
[f]^{ip) — f {V, cos if , V, sin ip) G S{S^) . In particular, 

P\k) = [ff{^)yi\k\-n). (13) 

Moreover, we have that \ f \ ^ — 1 1 [/] ^ 1 1 (s^ ) • The density of the quotient space relies 
then on the ordinary density result of S{S^) in L'^{S^). □ 



By Lemma 2.8 and Lemma 2.10 also ( 11 ) is a seminorm. 

Corollary 2.11. The functional (11) is a seminorm on 5(M^) and the corresponding 
equivalence classes are formed by functions that are equal when convolved with the 
Bessel function jo . More precisely 

\fi-f2\n=0 ^ {fi-f2h^0 

and in this case we write fi ^ji /2 Bind indicate by [.Jq the related equivalence classes. 

Definition 2.12. We will call TLfi the closure of the quotient space 5(M^)/ with 
respect to the norm \ . \ n o-nd denote by [f]n its elements. 

Lemma |2.8| can now be applied to the introduced Hilbert spaces. 
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Corollary 2.13. The spaces Hn and "hP are Fourier transformed of one another. 
More precisely the Fourier transform 

T: -Hn ^ 

is a bijection, isometric with respect to the norms ] ■ ] n o-nd ] . ]^ . 

Remark 2.14. The spaces Tifi andU^^ are Hilbert spaces. Indeed, forH^ the natural 
scalar product (., .)^^ is the one inherited from L'^ (S^) while for Ti,^ we can define 

{[f]nMn)n = {[ffA9f)L-(s^) = {fn,9)s'S 
where the last transition is due to Corollary \2.13[ 

We recall that by the standard arguments in [2H1 HZl and the theory of direct 
integral for SE{2), Lemma 2.10 and Corollary 2.13 provide the following. 

Proposition 2.15. The Hilbert spaces Tin and Ti.^ are SE[2) invariant. 

Working with equivalence classes allows some useful flexibility, but should be 
handled carefully. In order to avoid confusion, we explicitly state this corollary. 

Corollary 2.16. Let f be in L^{M?) and $ in L^{S^). Then 

i) an element [f]n ofH^ can be represented as an S' distribution by /o 

ii) we can unambiguously extend the notation [-J^ to S' distributions of type T — 
^if)^5{\k\ - n), meaning [T]^^ = 

Proof of ii). To any distribution T = ^{Lp)^5{\k\ — fi) we can indeed associate 
a function fT € L'^iW) such that [/t]^(¥') = '^{'■p)^ simply providing one L? 
prolongation outside the circle, e.g. fxik) = '^{'.p)g{\k\). So ii) amounts to say that 
we indicate for simphcity [T]^ to mean [/t]^- □ 

These notions allow us to define the Hilbert space of surjectivity for the SE{2)- 
Bargmann transform. 

Definition 2.17. Let us call 

Hni^^,S^) = {F:RlxSl^Csuchthate^F{q,e)isinL^{S^) 
and q !—> F{q, 9) is in Hn} 

and let us say that a function _F : x S'g — > C is CR^ if 

{X2-iXXi)F^0 (14) 

where Xi and X2 are the left invariant differential operators given by 
We define the SE{2)-Bargmann space as 

V¥^ = Hni^l ^ ^e) n Ci?^ • (15) 

On the basis of this definition we can indeed prove the following. 

Theorem 2.18. B^^ '■ ^'^i^^) ^ T^^h isometric surjection. 

Proof. By direct computation we can see that the functions S^$(<7, 9) satisfy equation 
([l4| for any $ e L^{S^). 
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(SI) 



(16) 



J SI 



can be calculated as for Lemma 2.8 i), providing 



(17) 



hence (161 is the S' representation of a Hq function, as from Corollary 2.16 
The isometry can now be proved since 



as in Corollary 2.16 ii), and 
difi / d0 



To prove surjectivity, consider a function F{q, 0) satisfying ( 14). Then its Fourier 
transform with respect to the q variables must satisfy 

{dg + Xk sm{0 — If)) FF{k cos ip, k sin 1^,0) —Q . (18) 

hence 

J'i^(KCOS^,Ksinv3,6l) = p>'=°''(''-'^)$((^)5(k) 
for some $(^),.g(K). ^ni F 'H^{'&^ , S^), so ^ e L^{S^) &nd g{K) ^ c5{k - VL). □ 

We remark that equation (18) is the same as equation ([T]), so the CR property 
on this space is a minimal uncertainty condition. 

As a corollary, we can express the inversion of the S'i?(2)-Bargmann transform in 
a familiar way. 



Corollary 2.19. The following holds 



$(^) 



Proof. By (17 1 we have 



L2(B2xSi) 



$(v?)^(5(|fc| -17) = N d0e^^''°'^'^~'^^TB^<i>{k,0) 

Jo 

= ^ [ [ dqe-*l'=l('?i™"'^+«2"'"'^)e^*^™"(^~^)S^$(g, 

^ Jo J R2 



ni'=i(0,g)u^^i'=i(^)(n"(0,g)7.^^",<i>)i.(5i 



dqd0 



L2(R2x5l) 



nl'=l((?,g)j.^-l'=l(^)(n"(0,g)ii^^^,ci>)i.(5i 



dqd0 



By Corollary 2.16 ii) we can then conclude. 



□ 
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This result shows expUcitly that the choice of the equivalence class does not 
amount to simply set |fc| — fl when applied to S' distributions, but rather allows to 
overcome the divergence that this position would give. This divergence is indeed the 
conterpart of the L'^{SE{2)) nonintegrability discussed in [T5]. In the end, the precise 
definition of the space "Hq provides a constructive way to realize the summability 
condition for the RKHS related to the 5'£'(2)-Bargmann transform that would result 
following the approach described in [1]. 



2.4- Connections with the Heisenberg group 

This subsection provides a relation between the symmetries defined by SE{2) and 
in terms of their coherent states transforms and the related complex structures. 
As we have seen, the S'£'(2)-Bargmann transforms are CR functions in the almost 
complex structure of SE(2). On the other hand, it is well known that the Bargmann 
transform is analytic with respect to the complex structure of M"*, that corresponds 
precisely to the symplectic structure that induces the contact structure of SE{2). As 



it will be clear with Proposition 2.22 the almost complex structure related to the 
S'i^(2)-Bargmann space is indeed the one induced on x considered as a real 
submanifold of \4^i . The center of , which prevents any direct relation between 
the two groups, does not interfere at the level of coherent states, since it behaves as a 
phase factor and is usually disregarded in favor of the usage of the so-called projective 
(Schrodinger) representation 1^ [T]. 

For notational convenience we recall the following two classical results. 

Definition 2.20. For any a e M"*", we obtain a family of minimal uncertainty coherent 
states for the Heisenberg group on L^(M^) as 

i^;jx)^Me'P<''-''^e-'-^ , ((?,p)eM"* (19) 

where M is the ^^(M^) normalization. In what follows we will indicate the space- 
frequency analysis provided by the coherent states transform as 

F{q,p)^{rg,pJ)mRn . (20) 
Proposition 2.21. The Bargmann transform of f £ L^(M^), defined as B^^ f{q,p) = 
e 3 F{q,p) is an isometry onto the Bargmann space 

=L^{Rl xRl,e'^^dqdp)nHol{Cl^ ,J 

where holomorphy is intended with respect to the complex structure Zj — {qj,a'^pj) 

{dp,+ia^dq.j)B'^" f , J = 1,2. (21) 

The simple observation that leads the argument consists in inspecting the 
frequency behavior of functions ( |19[ ) in polar coordinates. Setting 

cr^p^ A(cos6l,sin6l) (22) 

the localization in frequency space reads 

so in particular angular localization satisfies minimal uncertainty ([t]). 
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Proposition 2.22. Let F{q,p) be given by (20), and let U{k,p) be its spatial Fourier 
transform U{k,p) — J-qkF(k,p). By setting both variables in polar coordinates, call 
U^''^{(p,0) = U{kcos(p, Ksmip, cosd, sin9). Then the functions 6 i-^ U^''^{ip,9) 
are minimal uncertainty states for SE{2) in the ip-rotated representation 

Proof. Any C^-analytic function restricted to thie real submanifold obtained by fixing 
the modulus of p is a CR function [3] with respect to the vector fields that generate the 
group SE{2). Specifically, from the Cauchy-Riemann equations (21) it follows that 

(X2-za2|p|Xi)S"V = . (23) 
We note that since no derivation is performed along \p\, this equation equivalently 



holds also for (20), and we are in the same situation as in the proof of Theorem 2.18 
holding equation (18). 



□ 



Proposition |2.22| motivates the following. 

Theorem 2.23. Let us denote by the linear extension of to tempered 

distributions S' (see lEj), md let f G L^(IR^) then 

-B'''fn{q,p)^cBh[ff{q,0) 



where the constant c is given by c 



Proof. We prove the result first by showing that the Bargmann transform acts as a 
composition of S'i?(2)-Bargmann transforms, and then projecti ng t o an irreducible 
subspace. Calhng f^'^\(p) = f {k cos ^p, k sin ip), and according to (22) 



S« f{q,p) 



Me- 

M 

M 

TV 



dke 



e 2 



fik) 



+ 00 



duKe 



+ C30 



dnne 



dipe'^'^^'^^ cos 1^+92 sinip) ^XKCos{ip-e) 



and the normalization constants are M 



^ and iV = , ^ 



The p roof is concluded since if we perform the Bargmann transform on /^j, then 



by Lemma 2.8 i) Ffn{k) = f'\k) = [f]^(^):^5{^i - U). 



□ 



The relations among the various Hilbert spaces is now summarized. 
Corollary 2.24. The following diagram is commutative 



Vn 



, n^iRD^L^S^) 



where the map 'Hq{M.'^) — > V¥q is intended in the sense of Theorem 
transforms with respect to the p variable are considered as functions of the polar angle. 



2.23 and 
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Proof. The only relation that has not been inspected is Vn ■ 



regularity is due to 



while 



fiq,p) 



T'F^j. The CR^ 
, where the equivalence class is considered 



with respect to q, belongs to Hn{^q x Sg), where 9 is the polar angle of p. The 
commutativity (up to a constant factor) , can be seen by direct computation. Denoting 
with J-gfe the Fourier transform with respect to spatial variables 



S / ik,p) = 2TTa^M ■P"/(fc)e- 



'\p\\k\ cos{e-v) 



= 2cN [/y^e'"'l''l"™^(''-'^)^<5(|fc| - n) 



Then, by ([17|) and Theorem |2. 23 



{k,p) 



hence using Lemma 2.8 we have VnB^ f{q,p) — fn{q,p)- 



□ 



3. A model for activated regions 

The primary visual cortex VI shows a remarkable organization of neurons devoted to 
specific sensory measurements and axonal connections that allow elaborated perceptive 
tasks. Both are involved in the maps of orientations preference (0PM) shown in Fig[I] 
which have been measured by means of in-vivo experiments designed to activate 
specific cortical regions corresponding to populations of cells with similar preferred 
orientation [SI [7]. We recall here the model presented in that is able to describe and 
reproduce the images obtained by these experiments in terms of the S'£'(2)-Bargmann 
transform ([9]), hence providing a geometric interpretation for the 0PM. 



3.1. The functional architecture of VI 

VI is the first cortical area which elaborates the visual signal, sent by the retina. 
To each VI cell there corresponds a receptive field, a region of the visual field 
that, when stimulated, will cause a neuron response. VI is organized in a so-called 
retinotopic way, meaning that the centers of receptive fields relative to nearby neurons 
are correspondingly close. Moreover, nearby receptive fields are highly overlapping, 
providing a complete covering of the visual field. Since the works of Hubel and Wiesel 
in the 60's, VI cells are known to be selective for local orientations of the visual stimuli, 
i.e. the main direction that characterizes retinal images restricted to the receptive 
field. More recently, orientation selectivity has been described in a much deeper detail, 
the response of VI simple cells being modeled as a Gabor filtering in 13J, and this 
assumption has been lately validated experimentally [5S]. Given the input / G L?{M?) 
as a function on the retina, cell response can then be assumed to be given by F{q,p) 



as in ( 20 ) . The variable q denotes the center of a cell receptive field and p denotes 
a wave vector whose polar angle 9 characterizes the cell orientation selectivity. This 
response is a complex function, whose real and imaginary parts describe respectively 
the output of two different population of cells, called even and odd cells [25]. As a local 
approximation, we will consider the retina and VI as flat surfaces, and the retinotopic 
organization as the identity map [16], so that we can intend (7 g as the position 
on VI of a given cell. We will also consider, in an additional approximation, that 



the size of a receptive field, corresponding to the parameter a in ( 20 ) , is an intrinsic 
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constant parameter [3j. From the point of view of orientation selectivity, VI can be 
modeled [Ml HI] as the 3-dimensional fiber bundle x where each point {q,9) 
corresponds to a specific cell. The concrete two dimensional organization corresponds 
to a section that associates to a cell located at g a preferred orientation 6, and is 
commonly referred to as 0PM (see Fig{l] left). 

Axonal connections in VI can be broadly classified into two main classes: local 
connections, among nearby neurons, and long-range connections. In |12j it has been 
proposed a geometric model for long-range connections in the space x Sg as an 
implementation of the geometry of the SE{2) group, that considers two cells {q, 9) 
and {q',0') as connected by curves This approach has shown effectiveness in 

reproducing different tasks, described by the Gestalt principle of good continuation. 
Moreover, the connectivity of VI provides links between far away cells according to 
their preferred orientation ^9j, showing then the relation with 0PM. 

Several geometric analyses have been proposed concerning the formation of 0PM 
in terms of self-organization and in the framework of the physics of defects |29) . 
We must note also that the presence of spontaneous neural activities in the early 
development of the visual cortex plays a determinant role in the formation of 0PM. 
This is mainly due to the so-called retinal random waves |17| . that are wavefronts 
randomly propagating in the retina. Each visual cortex is then subject to a randomness 
that is characteristic of the specific animal, which is then coded in its realization of 
0PM. 

Some crucial principles of organizations of these structures were pointed out 
in |21| . noting in particular that the Fourier spectrum of the orientation maps is 
approximately concentrated on a circle (see Fig{l] right), or equivalently that these 
aperiodic structures possess isotropic internal correlations at a fixed characteristic 
length. A very recent analysis |19) quantifies these observations with much sharper 
instruments, and also include them into a generative model. In [21] it was also 
introduced an empirical method able to reproduce orientation map-like structures 
as a superposition of complex plane waves with random phases: indeed, if is a 
white noise with values in [0,27r] and indexed hy (p gV^, then the structures in Figjl] 
can be approximately reproduced as 

1 

9{q) — - arg / e^"^"^ cos {^{qi cos 4- 52 sin ip) + (pip) dip (24) 
2 Jo 

where the integral should properly be intended in Ito sense. 

The experiments that allow to obtain 0PM as in Fig{l] left [Sllllig rely on optical 
imaging techniques that quantify blood charge in the neural tissue using fMRI. This 
setting is then used to measure the activity in VI caused by cells responses to so- 
called gratings. Gratings are images constituted by straight parallel black and white 
stripes shifting along the perpendicular direction, that can be easily provided by plane 
waves with phase shift. Experiments with gratings have shown that activated regions 
depend only on the angle at which they are presented, or better the orientation, since 
the stimulus, and consequently the resulting activity, can not be distinguished at 
angles of tt due to the phase shift. An example of the images obtained is given in 
Fig[2j left. The result of this experiment is then a family of real maps {^a('J')}aepi j 
that can be used to obtain the 0PM coded with colors as in Figjl] by performing a 
vector sum and then considering the resulting orientation [8j (see Figj2] right): 

9{q) = ^ arg £ e'^" A Jq)da . (25) 
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Figure 1. Left: orientation preference maps in tree-shrew, coded with periodic 
colors (extracted from [9|). Right: power spectrum of orientation maps in 
macaque (extracted from |21|) 



We note that, starting from a given an orientation map 0{q), a way to obtain 
activated regions that are compatible with (25) is by scalar product, i.e. 



A 



(26) 



SO in particular if wc consider the construction (241, then ([26j) reduces to 

PIT 

A-a{q) — / COS {Q{x COS if + y sin If) + (j){ip)) cos{2{ip — a)) dip . (27) 



We are going to see that model introduced in [3] does indeed reproduce activities in 
the form (27), and hence 0PM in the form (p4|), but starting from a geometric model 



of the activities, so that 0PM arise as a consequence of the color coding (25) 



3.2. Reproducing activated regions 

The model we have proposed in [3 in order to reproduce the activity patterns resulting 
from the gratings experiment can be stated in terms of an 5'£^(2)-Bargmann transform 
of a specific white noise process. This will be properly symmetrized due to the intrinsic 
characteristics of the patterns, and the presence of randomness will be motivated 
in terms of the retinal random waves previously described. The geometry of the 
different activities resulting from the exposure to gratings at various orientations is 
then motivated in terms of the uncertainty principle, providing a description of a 
family of functions indexed by orientations in terms of a single function on the group. 



Statement of the model Given a white noise (j)^ with values in [0, 27r] and indexed by 
If G [0,7r], and considering a prolongation to ip G [0, tt] such that (l)ip+Tr = ^4'^^ we 
define the functions 

Ja 

recalling that they are minimal uncertainty states in the sense of Proposition |2.22| 
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eel 



as 



n(^F>l{q,9)-F>l{q,9+'^\ 



(28) 



These functions are indeed tt periodic in 9, to represent orientations, and provide 
opposite response at orthogonal angles: Ag^K = —Ag, as it is the case for VI cells. 



By direct computation we can explicitly write (281 in the following form 
Lemma 3.1. Calling 

^nif) = cosh (Ail cos ip) — cosh ( Afi sin tp) (29) 

then reads 



Ae{q) 



cos (il(<Zi cosi^ + q2 simp) + (j){ip)) V^{ip — 9)d(p (30) 



We note that, if we consider a real retinal image obtained as a superposition of 
plane random waves [T7] at a fixed wavelength as given by 



fix) 



then by Theorem 



2.23 



cos(i7(a;i costp + xi sin(p) + (j){^p))dLp 



the function can be obtained as the the resulting cell response 



in the form ( 20 1 . This in particular motivates the choice of random phases 



Comparison with the experiments In Fig[2] we show a comparison with the 
experiments. The parameters were chosen as Ail ~ 1, providing an approximate 
equipartition of uncertainty . However the results are stable under small variations 
of Ail. This is reasonable, since the functions (29) are such that 

Vii{ip) « cos(2v3) for \VL < 1 



up to a multiplicative constant. This ensures in particular that the expression (27) 



can be considered as an approximation to ( 30 ) 




Figure 2. Left, the configurations of orientation activity maps as experimentally 
observed (extracted from [9]). Center, a sample of the activity maps Ag produced 
by |30[ l. Right, gray valued images visualize the maps Ag by varying the angle 6. 
The color image has been constructed associating a color coding representation 
to preferred orientations, as in |25|. (Center and right figures extracted from [3|) 
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4. Conclusions 

The introduced notion of 5'i?(2)-Bargmann space allows to pass the problem of 
nonintegrability of the representation using a measure that is singular in the Fourier 
domain, hence reflecting the behavior of the irreducible representation. This method is 
constructive, and permits to perform integrations on the group in terms of equivalence 
classes. Moreover, the choice of a fiducial vector as a minimum of the uncertainty 
principle provides a relation between two symmetries that appeared unrelated as 
SE{2) and H^. This relation is given at the level of coherent states transforms, and 
relies on a compatibility of the complex structures associated to the coherent states 
of the two Lie groups, that can then be considered nested one into the other from this 
perspective. Moreover, it allows to complete the concrete construction of the space of 
surjectivity of the S'£'(2)-Bargmann transform. 

This approach unifies two main symmetries present in the maps of orientation 
preference of the primary visual cortex, and allows to produce a model that is able to 
reproduce neural maps of activity measured experimentally. The model is based on 
the uncertainty principle of SE{2), describing activated regions in terms of minimal 
uncertainty states. This uncertainty principle acts at the macroscopic level, hence 
does not rely on any microscopic physics assumption on the brain, but rather refers 
to functional features of the cortex. The modularity of the Lie group approach 
allows to extend the models to other higher symmetries characterizing the functional 
architecture, as in 26], and in perspective to model high level functionality of vision. 
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